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ABSTRACT 

The high school dropout rate is a matter for serious 
concern. Nationally, dropout prevention programs for at-risk youth 
have emerged and are increasing. In response to this situation a 
model middle school dropout prevention program was implemented for a 
small city public school system. This study assessed the 
effectiveness of the first year of the program. A variety of outcome 
measures are used to determine the program's impact. The results of 
the evaluation were then used as the base for program modifications 
in the second project year. The program encouraged students toward 
academic success. Students were paid wages in script for attending 
class, completing assignments, and behaving themselves. For the 
at-risk middle school sixth grade students (N=22) participating in 
the program, attendance, perceived competence, achievement test 
scores, and course grades were compared to test for significant 
d.lfferences at the end of the school year. The results indicated that 
students in the program did not demonstrate change on achievement 
criteria. No significant differences in self-perception between 
at-risk and not at-risk students were found. The consensus was that 
the positive aspects of the 9-month program were not sufficient to 
counterbalance the years of learned failure experienced by students 
in the program. It was concluded that if dropout prevention programs 
are to succeed they must increase their inten^.ity of treatment. 
(ABL) 
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Evaluating a Model Middle School Dropout Prevention Program 

for At-Risk Students 

Rita 6. O'Sulli van 

School of Education 
University cf North Carolina at Greensboro 



The high school dropout rate in the United States is a 
matter for serious concern (Hamby, 1989). Conservative estimates 
place the dropout rate at 25*/, nationwide (Mann, 1985). In North 
Carolina the dropout problem is even more severe. Figures show 
that in 1985 (Office of Educational Research and Improvement, 
1986) North Carolina ranked 37th in the nation with a high school 
graduation rate of 69.3%. Since 1985 the State has initiated a 
wide range of dropout prevention programs, however, the bulk of 
these funds have been directed toward assisting children aged 14 
and older. It is understandable and laudable that the State has 
chosen to address the problem at its most direct site, but it is 
well understood that the problem of marginality begins much 
earlier than the high school years (Sinclair & Ghory, 1987). 

Nationally, dropout prevention programs for at-risk youth 
have emerged and are increasi'ng (Karweit, 1988; Orr, 1987; SLavin 
& Madden, 1989). In North Carolina (Casebolt, 1988; O'Sullivan, 
1988), these programs have almost exclusively focused on direct 
intervention with the students, often completely isolating them 
from the regular scho-ol teachers and classes. Even when these 
programs prove successful, re-entry into the academic mainstream 
can erase the gains obtained. 

In response to this situation a model middle school dropout 
prevention program was proposed for a small-city public school 
system with a droDout problem estimated at 9.4%. Tne State's 
ave-age -is estimated at 7.6% c*^ the total enroLlment (Nof'th 
Carolina State Board of Eaucation, 19S7). The proposed program 
ccfnoined direct intervention for at-risk students unaer the 
guicance of a resource teacher i/itn concurrent staff development 
activities for reguLar teacr, ers. 

Tne proDosaL was furaed for two years by the Mary Reyr.oLcs 
EaocGCk Founaation, and program planning began in the sjinmer or 
193i. Du'-ing the 1938-89 acaderric year, selected at--isk sixth 
grade stucents spent part of the academic day (matn ana science 
classes) w'th a resource teacr, er skilled in working ...itn at-risk 
st^-cents, an3 the rer.ainder of the aay waj, spent v,it^. '-egula- 
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subject matter teachers. The resource teacher also served as a 
student advocate, including the facilitation of home/school 
coor di nat i on - 



Objectives of the Study 

The purpose of the study was to assess the effectiveness of 
the first year of the program. Researchers have consistently 
identified school based problems associated with dropping out of 
high school: multiple retentions in grade, poor grades, a 
history of truancy, and behavior problems that result in 
discipLinary actions (Catterrall 8 Stern, 1986; Farnworth, 
Schweinhart, & Ber rueta-C lement, 1985, Hess & Greer, 1986). A 
variety of outcome measures, therefore, were used to determine 
the program's impact. The results of the evaluation were then 
used as the base for program modifications in the second project 
year. For the at-risk middle school 6th-grade students 
participating in the program attendance, perceived competence, 
frequency of discipline referrals to the office, standardized 
achievement test scores, and course grades were compared to test 
for significant differences at the end of the school year. 



Met hodo logy 

During the first semester of the 1988-89 academic year data 
about the entering sixth-grade population were collected. 
Previous fifth-grade teachers' at-risk referrals were noted 
before school opened and were used to initially identify the pool 
of children from which to select program participants. 
Information about students' age and gender was collected 
concurrently with their perceived competence assessments during 
the first nine weeks of the school year. Data concerning the 
number and type of office referrals, attendance, and first and 
second semester's grades were gathered late in January and May. 
In May, all sixth-grade students also completed an achievement 
motivation measure. California Achievement Test (CAT) data and 
students' history of retention in grade were collected in June. 

S amp le 

The study was located in a small-city school district 

dropout rate above the state average. Contrary to national, 
state, and local trenas, tne typical cropout in this district is 
a white male. ALL sixtn graaers (n = 334 ) i r. tne scnool aistrict 
were rOL'sec ^.r zr.~ s = -e .t-'cci5 scnccL aLcr, c « i t r, liever.tn g-ace 
s lucent s. Tne re /sere '2 sixth- grace teacners whc taugnt in five 
separate tearrs (trree - twc-teacner teams anc two - tnree-teacner 
teams). Sti-cer, ts tcoK a'.L tneir major acacemic 3«wje:ts from 
teachers within their team, moving to the various classes on 
their schedules. St u cents re.r,ain in the middle school for 
ceventh grade and then go on to tne junior hign scnool for eigntn 
and ninth grace. 
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Students were identified for the demonstration classroom 
based on multiple measures. The first Level of screening used 
fifth grade teachers' at-risk referrals from the previous year. 
It is the school district's policy that all teachers complete 
Student Screening forms for those students they believe to be at- 
risk of not succeeding at school. Ninety-one students were 
identified in this manner from the total o^ 334 sixth grade 
student population. Children were then divided by homeroom and 
data about race, sex, 1988 CAT scores, past grades repeated, 
fifth grade final grades, and previous year's absences were 
collected for each of the 91 at-risk students who had been 
identified by the Student Screening Forms. In order to minimize 
scheduling disruptions, the 91 at-risk students were further 
reduced to 46, corresponding to the four homeroom classes 
selected for participation. 

To control for teaching effects, students were matched 
within teams, since all the students in a team have the same 
teachers. Treatment and comparison groups were then randomly 
assigned by class after they had been matched according to their 
at-risk rating. Weighted, multiple-measure at-risk ratings have 
been shown successful as a way to identify students at-risk of 
academic failure (O'Sullivan 1989, 1990). At-risk ratings were 
calculated using CAT percentile scores, number of grades 
repeated, number of absences, and current year teacher's at-risk 
rating. In this manner, 22 students were ranked, matched in 
pairs, and then were randomly assigned by pair to the treatment 
group or to the comparison group. Within a week of sending 
Letters home, parental permission was obtained for all 22 
children invited to participate in the program. 

Neas jrement s 

The majority of the measures used for the first-year's 
evaluation were taken from information common to regular school 
record-keeping. Report cards provided information about grades, 
absences, and promotion. School reports of CAT scores were used 
to collect the standardized achievement test data. The Assistant 
Principal's disciplinary action file provided disruptive behavior 
information. Observational data were collected throughout the 
first year of the project by project staff members. Two 
additional ins t ^u nent s, not part of normal school procedure, were 
also used in the study and are described below. 

rceotion Prcfile or 
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from .12 to .73. In addition to perceived competence on each of 
the six subscaLes, children are given the opportunity to rate the 
importance of five of the six subscaLes (excluding global self- 
worth). From this information a discrepancy score can he 
calculated. Harter argues that large discrepancies between 
importance and perceived competence can indicate low self-worth. 
Perceived competence data were included, since they address 
school-related affective issues included in the demonstration 
project's objectives. 

Achieveme nt Motivation . The Goa I Orientation Index (Atman & 
Romano, 1987) Ts theoretically grounded within the domain of 
conation, focusing on goal setting and attainment. It is a 96- 
item self-report scale that includes 12 subscales or conation 
cycles. It has been validated with 2,000 subjects and 
reliability coefficients ranging from .789 to .941 were reported 
for the 12 subscales. Since it has been described as providing 
useful information for improving decision making and has been 
used with at-risk middle school students, it was included as one 
of the affective measures of project effectiveness. 

Ihe Program 

Students in the demonstration classroom met for math and 
science instruction with the resource teacher for two consecutive 
periods each day. One group of 13 students met during the first 
and second period, while the second group of 9 met during the 
seventh and eighth periods. With the assistance of the project 
staff members, the resource teacher assessed every child's 
reading and math skills level, developed a personalized 
instructional plan for each student, and communicated with the 
students' parents about the semester's instructional goals. 

The overall strategy of the classroom was to encourage 
children toward academic success. The resource teacher 
introduced a reward system where students were paid wages in 
script for attending class, completing assignments, and behaving 
themselves. The students were paid on Fridays ind could exchange 
script for treats provided by the resource teachers. The 
stud^^nts took four field trips during the academic year to regard 
them for their work and to increase their sense of involvement 
with school. The trips were intended as positive motivators for 
continued good work. 

A doctoral stuaenis assistea tne resource teacner with the 
science component ot tne instruction Drogram. The grajjate 
student, a midGle s;:hooL science ecucator working en ner 
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In addition to the demonstration classroom's instructional 
program/ the school's counselor began a guidance program with the 
students in the project. She met with them once every two weeks 
during their regular math and science time for large group 
discussions about general issues relevant to early adolescence. 
In addition, with the help of the resource teacher and two 
graduate counseling students, the school's counselor organized 
four small-^group discussion sessions with the students that met 
once d week during the third period. The purpose or these small 
groups was to build trust among the members and also assist the 
students in problem solving. Each student was also paired with 
an adult who took the time weekly to meet individually with them 
and just talk. 

Students' progress in the program was reviewed in November 
when the teachers responsible for the 22 students met with the 
assistant principal, school counselor, and project staff members. 
Individual goals for the rest of the academic year were set based 
on the student's progress for the first nine weeks of the 
semester. Subsequent students' progress was reviewed on an 
individual basis determined by the resource teacher. 



Results 



Si xt h Grade Students 



Three-hundred and thirty-four sixth grade students were 
enrolled in the middle school during the 1988-89 academic year 
(171 females and 163 males). Average age of the students at the 
beginning of sixth grade was 12.2 years. Ninety-one students 
were identified as at-risk by their fifth grade teachers. Means 
and standard deviations for these students' fifth-grade 
California Achievement Test Scores are presented in Table 1. 
Scale scores for the entire sixth-grade group are close to the 
50th percentile. All of the differences between the at-risk 
group and the not at-risk group are significant at a .01 
probability level, indicating that the achievement level of those 
students identified by their fifth-grade teachers as at-risk was 
Lower that those students not so identified. Similar results 
were found for students grades the first and second semester with 
at-risk students scoring significantly lower (p<.01) than those 
not iaentified as at-risk. 
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Table 1 

Students ' Average F i f t h-6 ra de California Achievement Test (CAT) 
Results 





Entire 6th 
Grade 
(0=334) 


At-Risk 6th 
Graders 
(n=91) 


Not- 
6th 
(n 


At-Risk 
Graders 

= 243) 






Mean 


S£ 1 


Mean 


S_D 1 


Mean 


SD 


CAT 


Reading 


708 


52 


687 


41 


715 


54 


CAT 


Langua ge 


702 


41 


679 


42 


709 


38 


CAT 


Math 


725 


45 


701 


35 


733 


45 


CAT 


Total 


713 


39 


689 


36 


720 


37 



Results of the Se If -Pe r cept i on Prof i Le for^ Chi Ldren (Harter, 
1985) are presented in Table 2 for the entire sixth grade group; 
then for the 91 at-risk students and the remaining not-at-risk 
students. Average students' self-reported global self -worth, 
scholastic competence, social acceptance, athletic competence, 
physical appearance, and behavioral conduct are shown along with 
the importance rating for each of .he subscales with the 
exception of the importance of global self-worth which is not 
measured . 

It is very interesting to note that the highest possible 
perceived competence score is four, the Lowest one. The students 
in the sample, at-risk and not, consistently rate themselves as 
more competent on the various subtests than less competent. The 
difference between the at-risk group and the not-at-risk group on 
the varioLis scales is noteworthy in its relative Lack cf 
difference* In fact, t:ne only significant aifterences (d<.01; 
occur between the at-risk anc not-at-risk group in the imoortance 
they place on scroLastic competence and cen avioral conauct wnere 
in cotr ca^rS tr. e nct-at-^risK c'-c-.t Cw.:s"ic;ers inese z^z 
competence areas more ir.oortant man tn e at-risK group. 

Similarly, the Go a L £ll±r.lfJLi"Jl aoministered in May 

revealec'no difrerences cetneen t:.e at-risk sixtn-graae stu cents 
and those students not so identified. 
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Table 2 

Average Percei ved C ompetence Scores for Entire Sixth Grade 
At-Risk/ and Not-At-Risk Students 



COMPETENCE 

Global 
Scholastic 
Social 
Athleti c 
Phys i ca I 
Behavior 

II^ PORTANCE 

Scholastic 
Social 
Ath let i c 
Physical 
Behavior 



Entire 6th 
G ra de 
(n=33A) 



Mean 



3.1 
2.7 
3.0 

2.3 
2.9 
2,9 



3.3 
2.8 
2.9 
2.9 
3.3 



SD 



0.7 
0.5 
0.7 
0.7 
0.8 
0.7 



0.7 
0. 8 
0.8 
0.9 
0.7 



At-Risk 6th 
Graders 
<n=91 ) 



Mean 



3.0 
2.6 
3.0 
2.9 
2.9 
2.7 



3.2 
2.8 
2.9 
2.8 
3.1 



SD 



0.7 
0.5 
0.7 
0.8 
0.8 
0.6 



0.8 
0.7 
0.8 
0.8 
0.9 



Non-At-Risk 
6th Graders 
(n=243) 



Mean 



3.2 
2.7 
3.0 
2.8 
2.9 
3.0 



3.4 
2.8 
2.9 
2.9 
3.5 



SD 



0.7 
0.5 
0.7 
0.7 
0.9 
0.7 



0.7 
0.8 

0.8 
0.9 

0.6 



Treat men t ar.d Co inpa r i son Groups 

Table 3 presents fifth-grade CAT scores of the 22 treatment 
and 22 comparison group students. The only significant 
difference (p<.05) is for language arts and that difference shows 
the comparison group ahead of the treatment group. Differences 
between treatment and comparison group means were tested for 
significance (p<.Q5) and were not found significant for any of the 
other baseline variables, thus, supporting the assumption of 
initial equivalence of the two groups. 
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Table 3 

Treatment and Compar i son Gro ups' Aver age Fi fth- Ca r a de California 
Achievement Test 'TTrfT'ResuTt s 



T reat ment 
Group 
(n-22) 



CAT Reading 
CAT Language 
CAT Math 



CAT Total 



Mean SD 

687 13 

677 10 

707 24 

690 11 



Compa r i son 
Group 
(n==22) 



Mean 



686 



689 



698 



691 



SD 



20 



20 



18 



16 



Program Effects 

Differences 
grades for the f 
first semester s 
treatment group 
= 81-7, SD=8.5; 
comparison group 
Grade = 78.4 $2= 
mathematics, sci 
enrichment all s 
scores appeared 
shown in Table 4 
scores, there we 
groups . 



between the treatment and comparison group 
irst and second semester were analyzed. For the 
cience and mathematics grades showed the 
scoring significantly higher (Mean Science Grade 
Mean Math Grade = 85.5 SD=5.9) than the 

(Mean Science Grade = 76.2, SD^=10.1; Mean Math 
8.7). By the second semester, grades in reading, 
ence, social studies, physical education, and 
howed no significant differences. Although CAT 
to increase from the fifth to sixth grade as 
, when tested against comparison group CAT 
re no signficant differences between the two 
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Table A 

Treat ment and C ompa r i son Groups ' Average F i f t h-G r ade and Sixth 
Grade California Achievement Test (CAT) Results 







1 


Treatment 
Group 
(n=22) 


Compa risen 
Group 
(n=22) 








M e 3 n 


o U 


M A 2 n 
rl tr d 11 




GR 


5 


CAT Reading 


687 


13 


686 


20 


GR 


5 


CAT Readina 


698 


22 


707 


14 


GR 


5 


CAT Language 


677 


10 


689 


20 


GR 


6 


CAT Language 


676 


34 


688 


31 


GR 


5 


CAT Math 


707 


2A 


698 


18 


GR 


t 


CAT M^th 


721 


27 


717 


19 


GR 


5 


CAT Total 


690 


11 


691 


16 


GR 


6 


CAT Total 


698 


24 


704 


19 



Cone Lus ions 

A review of the oroject's results at the end of the first 
year Led school and project staff to a number of conclusions. 
The first conclusion was that although the students in the 
project were definitely provided with a specialized program that 
included counseling and the creation of a supportive, positive 
classroom environment for part of the day, it was not sufficient 
to demonstrate change on either of the two achievement criteria 
(grades and CAT scores). The consensus was that the positive 
aspects of the nine -mo nth program were not sufficient to 
counterbalance the years of Learned faiLure experienced by the 
stuaents n the Drogram. One teacner illustrated tnis point witn 
the example a stuaent in the program wno had successfully 
corr.Dletec a montn's contract mic-way tnrough the semester but who 
p,as jr5::Le to com;:lete nis next rr.crtr's contract. w^.en asKed 
wnat tre problem was ne tcLc tne teacner tnat sne just couLan*t 
exoect him to succeed all the time; it was a Lot of wo^k anc he 
just »*asn't used to it. 

The second conclusion was that if dropout preventi'.^" 
^Drcg'ams are to succeeo tney must increase their intensity of 
tre^Ltmert; expanding tne comprener?. i veness of the prooram :o 
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include the family and involve more of the school's regular 
teaching staff. In response to this conclusion, the second year 
of the project was redesigned so that a Home-School Coordinator 
(funded equivalently to a certified teachers) would work with a 
two-teacher sixth-grade team and a four-teacher seventh grade 
team. The Home-SchooL Coordinator would work with 20 identified 
at-risk students (10 from each team), their parents, and their 
teachers facilitating communication between home and school, 
advocating for students, tutoring, and providing a special, 
caring environment for students. Team teachers would meet 
periodically during the year to strategize ways in which they 
could work with the home school coordinator to increase success 
for their at-risk students across and within the curriculum. 
This modified structure of the project would gently tilt the 
responsibility for students' success back toward the teachers, 
since during the first project year the students in the 
demonstration classroom were often seen as the reource teacher's 
responsibility. With the home-school coordinator supplementing 
the instructional program, rather than teaching two academic 
areas, teachers would be more apt to change practice for the 
betterment of at-risk students. 

Finally, the project staff concluded that the prevailing 
wisdom assuming that at-risk students suffer from low perceived 
competence (self-esteem) warrants further investigation. From 
the baseline comparisons in the study made for at-risk students 
and those not-at-risk, results on the Se I f -pe r cep t i on prof i le for 
childr en showed no significant differences between the two groups 
in the level of their perceived competence, while there were 
signficant differences in the importance placed on scholastic 
competence and behavior. 

There is no question that the 91 at-risk students considered 
in this study are at-risk of academic failure in comparison to 
their not-at-risk peers. If this is the case and the at-risk 
students perceive their scholastic competence equivalent to their 
not-at-risk peers, then perhaps their failure to ascribe 
realistic competence levels could be closer to the central 
dilemma facing them in school than a crisis caused by lack of 
se If-es t eem. 

In conclusion the results of this study endorse a slow and 
arduous path toward amelioration of our nation's dropout problem. 

The lopscer stucen^s are cLLdw^cI tc ccnrinue in scnooLs witncLil^ 
experiencing acader^ic success, tne Longer stuaents are 
disaffected from tne olace called scnool, the longer teachers 
ignore their conrricjtion to tne creation cf a:-risK sfj cents, 
tne lor ze"" :t . tare >-3 to reci^ect tnerr. . It a tasK 
must attempt. 
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